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1.  INTRODUCTION 


In  studying  the  relationships  between  two  sets  of  variables,  it  is  of 
interest  to  test  for  the  rank  of  the  canonical  correlation  matrix.  The  purpose 
of  such  analysis  is  to  find  a  small  number  of  pairs  of  linear  combinations  of 
original  variables  which  would  best  explain  the  relationship  between  the  two 
sets  of  original  variables.  Bartlett  (1947)  proposed  a  procedure  to  test  for 
the  rank  of  the  canonical  correlation  matrix  and  derived  asymptotic  distrib¬ 
ution  of  the  associated  test  statistic.  The  above  procedure  is  the  likelihood 
ratio  test  (LRT)  procedure  (see  Fujikoshi  (1974)).  Fujikoshi  (1978)  derived 
asymptotic  nonnull  distribution  of  a  function  of  the  sample  canonical  correl¬ 
ations  whereas  Krlshnaiah  and  Lee  (197 9) derived  asymptotic  joint  distribution 
of  certain  functions  of  the  canonical  correlations  when  the  population  can¬ 
onical  correlations  have  multiplicity  and  none  of  the  canonical  correlations 
are  zero.  The  work  reported  above  was  done  under  the  assumption  that  the 
underlying  distribution  is  multivariate  normal.  But,  situations  arise  often 
when  it  is  unrealistic  to  assume  that  the  underlying  distribution  is  multi¬ 
variate  normal.  In  these  situations,  it  is  of  Interest  to  study  the  robustness 
of  the  standard  test  procedures  for  the  rank  and  derive  the  LRT  procedure  under 
non-normal  assumptions.  It  is  also  of  interest  to  study  the  distributions  of 
various  test  statistics  for  the  rank  of  the  canonical  correlation  matrix  using 
a  robust  estimate  of  the  covariance  matrix.  For  some  discussions  on  the  robust 
estimates  of  the  covariance  matrix,  the  reader  is  referred  to  Devlin,  Gnanadesikan 
and  Kettenring  (1975)  and  Maronna  (1976).  Murihead  and  Watemaux  (1980)  derived 
the  asymptotic  joint  distribution  of  the  sample  canonical  correlations  when  the 
underlying  distribution  is  elliptically  symmetric  and  the  population  canonical 
correlations  are  distinct  and  nonzero.  Fang  and  Krlshnaiah  (1982)  derived  joint 


distributions  of  certain  functions  of  the  sample  canonical  correlations  for 
large  samples  when  the  underlying  distribution  is  non-normal  and  the  popula¬ 
tion  canonical  correlations  are  nonzero  and  have  multiplicity.  The  results 
obtained  by  Fang  and  Krishnaiah  Include  the  term  of  order  n  also  where 
(n+1)  is  the  sample  size.  The  object  of  this  paper  is  to  derive  the  LRT 
procedures  and  derive  the  asymptotic  distributions  of  certain  statistics 
for  the  ranks  of  the  canonical  correlation  matrices  when  the  underlying 
distributions  are  real  and  complex  elliptically  symmetric. 

In  Section  2,  we  derive  the  LRT  procedures  for  the  rank  of  the  canonical 
correlation  matrices  when  the  joint  distributions  of  all  the  observations  is 
real  and  complex  elliptically  syunetric.  The  test  statistics  and  their 
distributions  in  the  above  cases  are  the  same  as  when  the  underlying  distribu¬ 
tions  are  real  and  complex  multivariate  normal.  The  above  situations  are 
different  from  those  when  the  underlying  distributions  are  real  and 
complex  elliptically  symmetric.  In  Section  3,  we  derive  asymptotic  joint 
distributions  of  the  canonical  correlations  in  the  latter  situations.  A 
discussion  of  various  test  procedures  for  the  rank  of  the  canonical  correlation 
matrix  is  given  in  Section  4.  Applications  of  these  procedures  in  the  area 
of  time  series  in  the  frequency  domain  are  also  discussed  in  this  section. 
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2.  LRT  PROCEDURES  FOR  TESTING  THE  RANK 
OF  THE  CANONICAL  CORRELATION  MATRIX 
IN  THE  REAL  AND  COMPLEX  CASES 


Let  X:  nxp  be  a  random  matrix  whose  elements  are  distributed  as  elliptically 
symmetric  with  density  function  (see  Kelker  (1970))  given  by 


f(X)  -  |l|“n/2h(tr  I^CX’X)) 


where  h  is  a  strictly  decreasing  and  differentiable  function  , 


(2.1) 


Z11  Z12 


E21  Z22 


,  X  -  (xL  x2) 


is  of  order  is  of  order  nxp^,  X2  is  of  order  nxp2  and  p  ■  Pj+p2. 

We  need  the  following  lemma  in  the  sequel  to  derive  the  LRT  procedure  for  the 


rank  of  £l2. 

*  -1/2  -1/2 

Lemma  2.1.  Let  S  ■  Q  P'PQ  ,  p  is  a  nxp  matrix,  Q  is  a  positive  definite  ma- 

T 

trix  such  that  the  rank  of  S  is  at  least  r.  Also,  let  1x^(0)  denote  the  set  of 

matrices  M  such  that  M  -  GF  where  G:  nxr  is  such  that  |G’G|^0  and  FF'  »  If. 

-1/2  -1/2 

Then,  the  eigenvalues  of  S(M)  -  Q  ( P-M) ’ ( P-M) Q  are  minimized  simultaneous¬ 
ly  with  respect  to  Me  xr  (0)  if  and  only  if 

IT  « 


M  -  PQ_1/^2V,V  Q1/2 
x  r  r 


(2.2) 


where  the  rows  of  consist  of  normalized  eigenvectors  corresponding  to  the 

A 

first  r  largest  eigenvalues  of  S.  The  minimum  values  of  eigenvalues  of  S(M)  are 

A 

given  by  where  are  the  eigenvalues  of  S  and  $  ■  0  for  j  >  p. 

For  a  proof  of  the  above  lemma,  the  reader  is  referred  to  Fujikoshi  (1974). 

We  now  consider  the  problem  of  testing  the  hypothesis  H  against  H  where 

s  c 

H  :  rank(E, ~)  ■  s . 


The  likelihood  function  is  given  by 


L-{|S22I  lzn.2l}"n/2  h<tr  EU.2CXl"  X2B)’(Xl‘ X2B) 


-1 


+  tr  E^X»X2) 


(2 


where  B  •  ^22^2i*  *8  seen  ^8ee  Anderson  sod  Fang  (1982))  that 


max  L-  (X  (h)}“np/2  h(p/X  (h)) 

n  y  mflx  m&x 

11.2*  22 


(ICX1-  X2B) ’ (Xx  -  X2B) j  I cx » X2) I ) 


-n/2 


(2 


where  Xmn^(h)  is  a  constant  depending  upon  the  form  of  h(*)«  Also 


(x1-x2b)'(x1-  x2b) 


|S11.21|I+S11.2CS22  S21  S22  B)  (S22  S2lS22  B)S11.2 


(2 


,1/2, 


and  rank(Zl2)  -  rank(S22  B) .  Here  S1;L  -  X’X^  S22"X2X2  and  sl2"XlX2* 


Applying  Lemma  2.1,  we  obtain  the  following  expression  for  the  maximum  likeli¬ 
hood  estimate  of  B  when  the  rank  of  B  is  s: 


b«  s7*s„,sM2  v’v  s71/2 


22  21  11.2  s  s  11,2 


(2 


where  V  consists  of  the  normalized  eigenvectors  corresponding  to  the  first  s 


largest  eigenvalues  of  S,_S -isT?-.  We  know  that  V'  V  -I  and  so 

11.2  12  22  21  Pl  ?1  Pl 


‘  ■  S22S21 


(2 


when  s  •  p^ . 


By  Lemma  2.1,  we  obtain 


s 


max 


max 


L  -  {X _ Chir^hCp/X^Ch)) 


Z12”«*!?  Z11.2,Z22 


max 


|SU-2I<U+  *.*, >•••(!+ *„.)> 


-n/2 


8+1 


(2.8) 


—1  '•l 

for  s  <  p1  where  A^. .  .>A  are  the  eigenvalues  of  S11.2S12S22S21*  Also, 


The 


max 


max  L-  {X 


El2€irp1(?)  Z11.2’Z22 


max 


LRT 


statistic  for  testing  H 


(h)r°p/2h(p/XmaJ[(h))  |SU_2|  . 
against  Ht  (t>  s)  is  given  by 


(2.9) 


n  ,,  2.  n/2 

t  ■  n  (1-r.) 

,t;  J..+1  1 


(2.10) 


where  r^>_. . .  vr^  are  the  eigenvalues  of  S11S12S22S21‘  When  the  underlying  diatributiol 


ia  multivariate  normal,  the  ahove  derivation  was  given  in  Fujikoahi  (1974). 


We  will  now  consider  the  LRT  procedure  for  the  rank  of  the  canonical  corre¬ 
lation  matrix  when  the  joint  distribution  of  the  observations  is  complex 
elliptically  symnetric.  In  this  case,  the  joint  distribution  of  the  observa¬ 
tions  is  given  by 


,np  1  _ 

f(Z)  -  - - h(2trE  Z'Z)  (2.11) 

\z\n 

where  Z  is  Hermitian  positive  definite  matrix  and  Z  denotes  the  complex  conju¬ 
gate  of  Z.  Complex  elliptically  symmetric  distribution  was  introduced  by 
Krlshnaiah  and  Lin  (1984).  When  h(y)«  exp(-y/2) ,  the  rows  of  Z  are  distributed 
independently  as  complex  multivariate  normal  with  mean  vector  0  and  covariance 
matrix  Z.  We  need  the  following  lemma  which  can  be  proved  along  the  same  lines 
as  Leona  2.1: 

ut  S.q-l/2P’PQ-1/2whereP!  uxp  ia  a  complex  matrix,  Q  ts  Henalclan 
positive  definite  matrix.  Also,  let  M  ■  GF  where  G:  u*r  is  a  complex  matrix  with 

!  G  *  G 1  j*  0  and  Ff’-Ir.  Then  the  eigenvalues  of  S(M)  -  Q~1/2(?-M) '  (jF^M)  Q”1/2 


are 


minimized  simultaneously  with  respect  to  Me  tt^(O)  if  and  only  if 

M-PQ'1/2V'V  Q1/2  (2.12 

r  r 

where  the  rows  of  consist  of  normalized  eigenvectors  corresponding  to  the 
first  r  largest  eigenvalues  of  S.  The  minimum  values  of  the  eigenvalues  of  S(M) 
are  given  by  4*^^  where  <}>^>_. .  *^4>p  are  the  eigenvalues  of  S  and  *  0  for  j^p. 
Consider  the  likelihood  function 


--1 


' _  n 


- - - -  h(2 tr  l.t  «(Z.-Z_B)  *  (Z  -Z_B)  +  2  tr  Z.t Z’ZJ 

[  |  E22 1  |  E112 1 1  u-2  1  2  1  2  22  2  2 


where  B  -  Z~2  Z,^.  As  in  the  real  case,  we  can  show  that 


onP  * 

,  L't7*_ r>Ph<2p/Xmait(t)i 

11.2,2*22 


z  1 

Mm  ■  ■ 

x*  (h)rr 

max 

L  •> 


X  (KZj-ZjBJHZ^Z^IIZ*  z2|> 


-n 


where  X  (h)  is  a  constant.  But 
max 


Cz1-z2b)»(z1-z2b) 


(2.13 


(2.14 


lW11.2llI+Bn'2W22'’2“21-^2B),<W22/2M21-M222B)Wn'2  <2-15 


and  rank(Z12)  -  rank^^Z^) .  Here  Wu«  Z'Zr  W22«  Z’Z2  and  W^-  Z^Z. 
So,  by  Lemma  2.2,  we  obtain 

,np 

max  max  l  *  r-^ - -j 

E125"s(?>  EU.2-£22  jW"]" 


2  r  * 

max  max  L  ■  ri - >  h(2p/X  (h) ) 

inp  r  max 


Iw.  J  n  ci-e.)n 


x 


(2.16 
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where  9^>_. .  .>0^  are  the  eigenvalues  of  the  matrix  WiJWi2^22W21* 
Also, 


£  - 


C2.17) 


* 

where  V  consists  of  the  normalized  eigenvectors  corresponding  to  the  first  s 
s 

largest  eigenvalues  of  ^J^2W12^22W21’  **°»  the  LRT  statistic  for  testing  Hg 

against  is 


t*  -  n  (l-e  )n. 

sc  j-s+l  3 


(2.18) 


So,  the  LRT  statistic  for  testing  Hg  against  the  alternative  that  is  °f  full 
rank  is 


'  -  n  (i-e.)  . 

8pl  j-s+l  J 


(2.19) 


Similarly,  the  LRT  procedure  for  E12  ■  0  against  the  hypothesis  that  the  rank 
is  t  is  given  by 


'ot  ■  "  (i-yn- 

j-i  J 


(2.20) 


Here  we  note  that  Anderson  and  Fang  (1982)  derived  the  LRT  procedure  for 


^12  =0  when  the  underlying  distribution  is  real  elliptically  symmetric. 


3.  ASYMPTOTIC  JOINT  DISTRIBUTION  OF  THE 
CANONICAL  CORRELATIONS 


We  will  now  derive  the  joint  asymptotic  distributions  of  the  canonical 
correlations  under  two  situations.  In  the  first  situation,  we  assume  that  the 
density  of  Z*  *  [x^,...,xn]:  p*n  is  of  the  form 

f(X)  -  |e  |_n//2hCtr  E^XX*).  (3. 1] 


In  the  second  situation,  we  assume  that  x^,...,xn  are  distributed  independently 
and  identically  with  a  common  density 


f(x)  *  |l  |  ^^h(tr  E  ^xx1). 


Without  loss  of  generality,  we  assume  that 


where  <  p2. 


0—  ■ 
0  , 

0 


(3.2 


(3.3 


(3 


4: 


In  addition,  we  assume  that 


9 


where  p_>...>p  >  0.  When  the  underlying  distribution  has  density  (3.1),  it 

X  s 

is  known  (e.g.,  see  Cambanis ,  Hwang  and  Simons  (1981)  Anderson  and  Fang  (1982)) 
that 


X  -  RUA  (3.6) 

2 

where  R  *tr  X’X,  and  vecU  has  uniform  distribution  on  the  unit  sphere  indepen- 
2 

dent  of  R  ,  Z»  A' A,  A  -  (A^  A2)  and  A^  is  of  order  pxp^.  Here  vecU  denotes  the 
column  vector  formed  by  putting  each  column  of  U  one  below  the  other.  Then, 

X^  *  RUA^  and  X2  -  RUA2.  So,  *n<*ePen<*ent  R*  Also,  U  can  be 

expressed  as  U  *  V/trV'V  where  the  rows  of  V  are  distributed  independently  as 
multiviarate  normal  with  mean  vector  0  and  covariance  matrix  I .  Hence,  the  dis¬ 
tribution  of  ^iJs^2^22S21  is  in<^ePen^ent  th®  particular  form  of  the  under¬ 
lying  distribution  as  long  as  the  underlying  distribution  belongs  to  the  family 
of  elliptically  symmetric  distributions.  We  will  now  derive  the  joint  asymptotic 
distribution  of  the  eigenvalues  of  the  sample  canonical  matrix  when  the  observa¬ 
tions  x1,...,xn  have  a  common  density  (3.2). 

We  need  the  following  lemmas  in  the  sequel. 

Lemma  3.1.  If  x'  *  (x^,...,Xp)  is  real  elliptically  symmetric  distribution  with 
finite  fourth  moments,  and  density  given  by  |l|  ^\(trZ  l^xx'l,  then 

E(VjYt>  '  ♦♦”t0)(V'tt+"ikoji+oitV  °-7) 

where  <j>"(.*)  denotes  the  second  derivative  of  <K*)  and  Z  «  (a^). 

Now, let  S11  -  (a^),  Si2  "  ^big^  and  S22  *  ^Cgh^*  Also*  Iet 
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a1±  —  2n*‘C0)  -  2/n  «»C0)uli 
-r  2«4T  4>  *  CO ) u± J 
bli»  -2n0,(O)p1-  2n$'(0)vli 

bij  ""  2*‘(0)^  Vig  (i*&)  (3.8) 

c  *- 2n$*  (0)  -  2/n  w  $*(0) 
gg  gg 

Cgh  2^’(0),/“  wgh  (8,*h) 
for  i,j*  l,2,..,,pj  and  g,h  ■  1,2,.. 

Lemma  3.2.  The  asymptotic  joint  distribution  of  u^'s,  vtu*8  and  w^'8  *8 
p(p+l)/2  variate  normal  with  mean  vector  0  and  second  moments  given  In  the  follow¬ 
ing  statements: 

(i)  any  and  w^  which  has  at  least  one  suffix  number  >  p^  is  uncorrelated 
with  all  the  others; 

(ii)  any  meatier  of  one  of  the  sets  (u^.v^.w^)  (i-  l,.,.,p),  (u^  »v1j  »wAj)  * 
(i,j*  l,...,p^;  ii4  J)  is  uncorrelated  with  all  the  members  of  all  the  other  sets; 

(iii)  for  i,J  -  l,...,p,  we  have 

E  uii“  E  Wii  “  3<K+1>-  1 
E  v2±-  (<+l)  +  p2[2(k+1)-1] 

E^Uiiwii>  “  «+  2(<+l)p2 
E(Uiivii)  -  E(w1±v11)  -  [3(ic+l)-l]pi 

Etu^-E^J-ECw^)  -<+l  (if*  j)  (3.9) 

E<uijWij >  "  E^vijvji)  "  (|C+1)PiPj  (i^j) 

E(uijVij  )  “  E(wijvij*  "  (K+1)Pj  ( A  f*  j) 

where 


Proof:  The  asymptotic  normality  follows  from  well  known  central  limit  theorem 
We  prove  only  (iii).  From  (3.8)  we  have 


Also, 


2  1 

E  u  -  - =■  Var(a  ). 

11  4u[4>'(0)r  11 


V»r  ail  ■  £  Var  *1U  . 

i-i 


n  [3(tc+l)-l] 


where  X 


(xtU)  for  t  -  1,2.  So, 


E  u^±  -  3(k+1) -  1. 


Similarly , 


E  IE  a. .c, .  -  4 £<p  1  (0) ]  n  j 

11  11  4 [ *  (0)  n  11  11 


and 


E  \l*  \kiX2U 

k,i-l 


-  4[«’(0)]2n[<+ 2 pj(<+l)]  +  4 [ d»  *  (0)]2n2 


So 


E  uilWii  -  <  +  2pi(ic+l). 


In  the  same  manner  we  can  prove  other  relations. 

Lemma  3.3.  Let  g^Cx)  be  a  sequence  of  K-degree  polynomials  with  roots  X^n\.. 
for  each  n,  and  let  g(x)  be  a  k  polynomial  wtih  roots  x. . x.  ,  k<^K.  If 


g  (x)  ■+■  gCx)  a a  n+ »,  then  after  suitable  rearrangement  of  x,  , ..., 
n  1 


.VU/ 


we 


» 


have  xj“'  -*>  x  ^  ,  j  -  1,2, . . .  ,k  and  js^l  -*■  “»  ,  j-k+l,...,K. 


For  a  proof  of  the  above  lemma,  the  reader  Is  referred  to  Bai  (1984). 

We  have  the  following  theorem. 

Theorem  3.1.  Let  the  population  canonical  correlations  be  p^,...,p^  which 
satisfy  (3.5).  Also,  let  the  sample  canonical  correlations  be  r  , ...,r  where 

l  p. 


r  >...>r  >  0.  In  addition,  let 


1-  ~  P 


-  n^2(l  -  p»2rX  O^-p*) 


for  i  -  1,2,. . . ,p^.  Then  the  limiting  distribution  of  n^,...,n  is  represented 


by  the  density  function 


f(nl . V)f(V+l . V+v +...4u  . . ns)  fl(ns+l . ni 

IX  lx  1  s— l 


( 


where 


f<*! . «.)  - 2'"<“H-iy2&+n"/2  C  "  r  ill  -xc  "  '  c-a - i-» 

t-1  ^  ^ 

1  °  2 

*  exp{-  luTir  *—<  *i 


.  <  ® 


(p,-sl -i(p  -«)  (p  -sjCPi-sJ/Z  Pi”8 

f1(j1s+i*”*,npLi  "  2  17  {  n  r(Y0^-8-i+]))r(j 


i>) 


i-1 


2  T(p0-Pi > 


Si  Si  Sl  V  2  1 

i-s+1  j-i+1 <+1  1  J  i-8+1  <+1 


*rl  2 

4  >.  °1^  !•••<»>.. 


X 


expC- HiiT 


<  « 


13 


i*’«»r 

Proof.  Most  of  the  proof  Is  similar  to  the  proof  given  by  Hsu  (1941)  for  the  case 

when  the  underlying  distribution  is  normal. 

(1)  We  find  the  limiting  distribution  of  r_+i»**‘»rp*  the  8mallest 

1 

canonical  correlations. 

2  2 

We  know  that  r^  >_  are  positive  roots  of  the  determinants!  equation 


rSll  S12 


S„,  rS._ 
21  22 1 


(3.13) 


Starting  from  (3.13),  we  obtain 


|D-(nZ /Oc+l))l|  -  0 


(3.14) 


where  D  -  (dQj) »  «nd 


dii  "  £  '  "fvi8  "  8+1 . Pi 

J  g-s+1  1 

Let  C  ,  >.„>?  be  the  eigenvalues  of  matrix  (d. .). 
s+l  —  _  P1  ij 


(3.15) 


Then  by  Lemma  3.3  we 


n1^2^  -*•  Kic+l)^]172  i-s+l,...^. 


(3.16) 


By  Lemma  3.2  we  knew  that  the  variables  are  uncorrelated  and  asymptotically 

/e+1 

distributed  as  normal  with  mean  zero  and  variance  1.  Therefore  the  limiting 

n  r| 

distribution  of  the  “-^*has  the  density  function 

-<P  i2  <p  -s)/2  v*  -  P|  Pl 

2  i  (.n,r{|(q-s-i+i)r|i})  n1  n1  «.-«.)> 

i-S+1  J-i+1  1  3 

p  pi 

»(-  4  y  ?.) 


x  {  n  c.) 


(3.17) 


14 


2 

n. 

Since  ^  .  the  density  of  the  limiting  distribution  of  the  n1-n1^2r1 

is  represented  as  (3.12). 

We  now  find  the  limiting  distribution  of  r1f...,r  .  From  (3.13)  we  have 

X  s 


|S12S22S21-r2sUl  ’  0 


(3.18) 


Setting  0  -r  and  following  the  same  lines  as  in  Hsu  (  1941b)  ,  we  obtain,  as  n-*-®. 


where 


F 


0 


(3.19) 


F«  "  ‘-J’1 . v 


(3.20) 


Let  be  the  roots  of  (3.19).  Then  by  Lemma  3.3  we  have 

A  U, 


n1/J(9l-pJ) 


n  -*■  ®  i“l,...,u. 


(3.21) 


From  Lemma  3.2  we  easily  get  that  Ffs  approach  (y ^+1)  normal  variates  whose 
means  are  zero  and  second  moments  are  as  follows 


E  fr^)  -4(<+l)(l-p2)2 

E  (F^)  -  2(*+l)(l-p2)2  i*j  (3.22) 

E  F^F^  »  0  i»k  or  j  or  i^k  and  j  i  i. 

Hence  the  limiting  distribution  of  may  be  derived  as  the  distribution  of  the 
eigenvalues  of  the  matrix  (F^ )  in  which  the  F’s  are  regarded  as  normal  variates. 
Let 


>■ 


5 


Fii  *  2Vk+1  (l-p^)t^ 


(3.23) 


F£j  -  /2(H-1)  (l-pJ)t1:J  i  1*  j  » 


Che  t's  are  muCually  independent  normal  variates  with  zero  mean  and  unit  standard 
deviation. 


Setting  5  m  Id-p^n  in  (3.19)  we  get  by  (3.23) 


tu-(^l)-l/2n  2-1/2t 


12 


...  2-1/2t 


Mi 


2-1/2t 


V!*l 


2-1/2t 


yl*2 


t  -(<+l)_1/2n 


Vl 


(3.24) 


Let  •  •— nu  be  the  roots  of  0*24).  Then  we  get  the  limiting  distribution  of 


,  from  Hsu  (1939),  as 


f  (nl ,  • . .  ,n*  ) 

i  M1 


-y1Cn1+l)/2 


-V2  “i  i  -1  "l  \ 

(K+1)  yjrii)  {^^(-^z- 


-)} 


k+1  /k+1 


exp{-  2SS1J  ni2)  ” ’  "i-  '  -V"  ' 


(3.25) 


Similar  to  Hsu  (1941b)  if  we  define 


,  -1/2  „  2.  .  , 

ri  ■  pl  +  n  (1-P1)n1  i  “  1»» • • 


then 


1/2.,  2.-1.  . 

ni  *  n  (1-P2 )  (fj-Pi ) 


have  the  same  limiting  distribution  as  the  Hence  the  limiting  distribution 

of  has  the  density  f(n1,...»n  )• 

1  Wx  A  W1 


*  •  _»  *  •  ■  •  *  fc  *  |  '  "Ji  *•*#*»’  »*»*  ,*.,.*k,»"****»*.’«,,*»'»*»*  .* 


In  exactly  the  earn  manner  we  may  prove  that  for  l  -  1,..., 


a  the 


„  .  1/2 ..  2.-1.  , 
nt  -  n  (l-P4)  (r£-p£> 

i  ■  Uj+. .  .+v^_j+l,  . . .  ,Uj+. .  ,+y^ 

have  the  limiting  distribution  represented  by  the  density 


*»vr  X  X..  X  X.' 

•  *+U4— 2+1  y^+...+y^ 

where,  in  general,  f (*,...,»  )  is  represented  as  (3.11). 

x  m 


It  is  easy  to  see  that  the  sets  (n. »...,n  ),  (n 


I  I  1  f  e  •  •  f  n  1 
“l+1  ul+u2 


)»•••» 


(n  iu,+.  ..+u  +l****,nji  ^  (na+i . .  )  are  independent  of  one  another.  The 

T.  s— 1  *s  * 

proof  is  complete. 


Remark.  We  may  see  from  Theorem  3.1  that  in  the  elliptical  distributions 
family  the  limiting  distribution  of  sample  canonical  correlations  depend  only 
on  parameter  *c.  In  the  normal  case  <  •  0-and  in  this  case  Theorem  3.1  reduces  to 


the  result  obtained  by  Hsu  (1941b) . 


We  will  now  derive  the  asymptotic  joint  distribution  of  the  eigenvalues  of 
the  complex  canonical  correlation  matrix  under  two  situations.  In  the  first 
situation,  we  assume  that  the  density  of  2  is  given  by  (2.11).  As  in  the  real 
case,  we  can  show  that  the  density  of  W^jv^W^  *21  is  the  same  as  when  the 
underlying  distribution  is  complex  multivariate  normal.  In  the  second  situation 
we  assume  that  2^ , , , . , Z_  are  distributed  Independently  and  identically  with  a  common 


density 


f(Z)  -  2P  |r |_:LIi(2  Z*Z_1Z). 


(3.26) 


In  this  case,  the  characteristic  function  of  Z  is  given  by  <Kt'Zt/2)  and  the 
covariance  matrix  of  Z  is  -2<|>’(0)Z.  We  can  show  that 


„Z  }«  +S..O.  o.  .) 


E{ZjZkVmJ  ~  ^  v''/wjkwim■''j^km'''jm''k^, 


(3.27) 


and  the  elements  of  the  matrix  W,  after  suitable  standardization,  are  jointly 
distributed  as  complex  multivariate  normal. 


Now,  let  .v\*  denote  the  eigenvalues  of  8uch  that 


A’*. . .«A'  ■  A, 

1  1 


Xi1+l",,*“Xi14v2-  X2 


(3.28) 


\  t  1  a\ 

u,+.  ..+U  -+1  |l,+.  .  ,+W  8 

1  8-1  1 '  S 


A’  -...-A*  -0 

s+1  p. 


where  A->...>A  .  Also,  let 
1  s 


-  n1/2(l-A')_1(0i-A’) 


(3.29) 


for  i *  1,2 . Pj^.  Also,  let  be  distributed  independently  and  identi 

cally  with  a  common  density  function  given  by  (3.26).  Then,  following  the  same 
lines  as  in  Theorem  3.1,  we  obtain  the  following: 


Theorem  3.2.  The  joint  asymptotic  density  function  of  6.,..., <5  is  given  by 


gC«1,....«p  ..gC«  +#>i+w  +i».--4y  +>#>+u  ) 

A  i  1  8—1  1  8 


*  8l(6s+l . 6p1) 


n  d  q  x  x 

g(x  )- (^+i)"m/2(  n  r(i))-1{  n  n  (— - - i-)} 

i-i  i-ij-i+i  /mT  /*+T 


(3.30) 


exp{-  l  xf/Oc+l)} 
i-1  1 


(3.31) 


8lC6s+l’' 


p.-S  p  -8  -(p.-«) 

,5  )-u  {  Ti  r(p,-s-i+i)r(i)>  1(tc+i)  L 


h  Pi 


x  {  n  n  {(s  -62)/(x+i)}{  n  («2/k+i)}  2  1 

1-8+1  j-i+l  1  J  i— 8+1  1 


X  exp{-  l  52/ (k+1) } 
1-8+1  1 


(3.32) 


rco)-  u'co)}' 

{♦•CO) }Z 


(3.33) 


We  will  now  discuss  the  relationship  of  the  results  of  this  section  with 
the  earlier  work  of  Fang  and  Krishnaiah  (1982),  Fujikoshl  (1978),  Krlshnalah 
and  Lee  C1979),  and  Muirhead  and  Waternaux  (1982)  who  used  perturbation  technique 


around 


2  2  l  i 

Let  f. (r, ,,,.,r  ),  (1-  1,2,. .,,k) ,  be  an  analytic  function  of  r.,...,r 

1  1  P],  P1 

d  p'^,t . .  ,p’2.  In  addition,  let  L.  -  i/n  {T,  (i. , . . .  ,1  )-T.(X  ,...,X  )}, 

l  p^  i  1  P^  1  *■ 


3Ti^rl*‘ ,'*rp  * 

_ L 


32Ti(r2 . rj  ) 


(3.34) 


for  Ja,  i2€  Jg,  A-  (Ax 


A  )  ’ ,  I  ■  (A,  ,...,£  )*,  A  -  p  ! 2 ,  £ .  ■  r^  and  J 

1  i  i  9  i  i.  a 

denotes  the  set  of  integers  u,+...+y  ,+l, . . . ,u,+. • .y  for  a  -  1,2,. ..,k. 

1  a-i  i  a 

When  canonical  correlations  have  multipicity  as  in  (3.5) ,  and  the  underlying 

distribution  is  multivariate  normal,  Fujikoshi  (1978)  derived  asymptotic  expression 

of  whereas  Krishnaiah  and  Lee  (1979)  derived  joint  asymptotic  distribution  of 

. T^.  In  both  of  the  above  papers,  it  was  implicitly  assumed  that  none  of 

the  population  canonical  correlations  are  zero.  If  p^+^“...*p'  *  0t  then  the 

1  -1/2 

joint  asymptotic  distribution  of  up  to  term  of  order  n  can  be 

obtained  by  following  the  same  lines  as  in  Fang  and  Krishnaiah  (1982)  when  the 
underlying  distribution  is  nonnormal.  Here 


Lio  ■  ^  <Vri- 


,ra)-T1(A1,...,As)} 


for  i*  If 2 f  •  ••  fk*  Now 9  let 


/aCii-Ai) 

ci  *  2p’Cl-A1) 


(3.35) 


for  1*  1,2, . . . ,p^  when  none  of  the  population  canonical  correlations  are  zero. 

Muirhead  and  tfaternaux  (1980)  showed  that  c, ,...,c  are  asymptotically  distributed 

1  Pl 

independently  as  normal  with  mean  0  and  variance  one  when  xi » ’  •  • » xn  * 8  a  sample 

from  a  population  with  density  (3.2)  and  the  population  canonical  correlations 

are  distinct.  Fang  and  Krishnaiah  (1982)  derived  the  joint  asymptotic  distribution 

of  L^,...,L^  when  the  population  canonical  correlations  are  positive  and  satisfy 

the  relation  (3.5)  and  the  underlying  distribution  is  nonnormal.  In  their 

expression,  the  first  term  involves  multivariate  normal  density  whereas  the  second 

—1/2 

term  (which  is  of  order  n  '  )  Involves  multivariate  Hermite  polynomial.  If  we 


ignore  the  second  term,  a  special  case  of  the  above  expression  is  the  result  of 
Muirhead  and  Waternaux  (1980). 


Now,  let  us  assume  that  the  first  s  canonical  correlations  have  multiplicity 


as  in  (3.5)  and  >  0  and  x^,...,xn  is  a  sample  from  a  population  whose 


density  function  is  given  by  (3.2).  Then,  the  asymptotic  joint  distribution  of 


,n  is  obtained  in  the  same  way  as  the  asymptotic  joint  distribution  of 


ri,,...,n  is  derived  in  section  3.  The  joint  asymptotic  distribution  of  n1f...,n 


is  this  case,  is  given  by 


f (n. ,. . • ,n  )f(n  n  .  )•• .f(n  ,.»«••  ,n  ) 

J-  y y^  ^2  s*i 


(3.36) 


where  f(x  , . . .  ,x  )  is  given  by  (3.11).  Now,  let  T.  (i,  )  ■  i . .  If  u  >  1 

i  n  l  l  p  i  i 


for  at  least  one  i,  the  asymptotic  joint  distribution  of  c,,...,c  cannot  be 

1  P1 


obtained  from  the  results  of  Fang  and  Krlshnaiah  (1982)  since  the  assumption 


*  *  * 

(3.34)  is  violated.  But,  the  joint  asymptotic  distribution  of  c^,...,c  ,  cg+1 


follows  from  the  result  of  Fang  and  Krlshnaiah  (1982)  where 


-(U 


_t  2p  (1-P?)u  U1+---+V1+l . ~U1+...+Ut 


t  t 


+...«  .  )-«„i+...+llt_1+-+\i+...^t»  »•«> 


The  above  result  follows  also  from  (3.36). 


4.  APPLICATIONS 


In  this  section,  we  discuss  procedures  alternative  to  LRT  procedure  for  test¬ 
ing  the  hypotheses  on  the  ranks  of  the  canonical  correlation  matrices  in  the  real  and 
complex  cases. 

We  wish  to  test  the  hypothesis  H  against  the  alternative  that  H  is  not 

s  s 

2  2  2  2 

true.  We  can  use  a  suitable  function  (r  r  )  of  r  ,r  as  test 

s+1  px  s+1  pL 

statistic  to  test  for  H  .  The  hypothesis  H  is  accepted  or  rejected  according  as 

s  s 


*(Vl . rPl>  5  ca 


(4.1) 


where 


P^(rs+i’***,r^  m  (1“a) 


a '  s 


(4.2) 


2  2  2  2  2 

We  can  choose  <J;(r  .,»•••, r  )  as  r  .  ,,r  ,,+... +r  ,  etc.  When  H  is  true,  the 
s+1  p.  s+1  s+1  p  ’  s 

2  1  2  1 

joint  distribution  of  n(r  -/<+l,...,r  /<+ 1)  is  the  same  as  the  joint  distribution 

s+l  p^ 


of  the  eigenvalues  of  the  central  Wishart  matrix  of  order  (p1~s)x (p^-s)  and 


(p^-s)  degrees  of  freedom.  So,  we  can  get  approximations  to  the  percentage  points  of 
2 

rg+i  from  the  table  of  the  distribution  of  the  largest  eigenvalue  of  the  central 

Wishart  matrix  W  and  E(W  )  %r„ 

Pl-s  Pl-s  2 

Krishnaiah  (1980).  Approximate  percentage  points  associated  with  the  test  based 


(p  -s)I  _  .  These  tables  are  given  in 


prs 


2  2  2  2  , 

upon  (r  ,,+..+r  )  can  be  obtained  since  n(r  ,,+...+r  )/(k+1)  is  asymptotically 

s+1  Pj^  s+1  p^ 


distributed  as  central  chi-square  with  (p^-sXp^-s)  degrees  of  freedom.  We  will 


now  discuss  a  sequential  procedure  to  determine  the  rank  of  the  canonical  correla¬ 
tion  matrix. 

The  hypothesis  Hq  is  accepted  or  rejected  according  as 


2  < 

r.  >  c, 

1  la 


(4.3) 


where 


(4.4) 


P[rl^ClcJH03  ‘ 


If  Hg  is  rejected,  we  accept  or  reject  according  as 


2  < 


r2  >  c2a 


(4.5) 


where 


p[r2  1  c2a  ^  ri  -  CIa;  V  =  (1~a2)* 


(4.6) 


When  is  true,  far*/-! . nr*  /«*!)  are  asymptotically  distributed  independent 

2  A 

of  r^  as  the  joint  distribution  of  the  eigenvalues  of  the  central  Wishart  matrix 


W(p  -1;  p2-l;  I);  here  W(r,t;I)  denotes  the  Wishart  matrix  of  order  r*r  with  t 


degrees  of  freedom  and  the  expected  value  of  the  matrix  is  ri.  If  is  accepted, 
we  do  not  proceed  further.  If  is  rejected,  we  accept  or  reject  H2  according  as 


2  < 

r3  >  C3o 


where 


P^rl  -  C3alH2’C2  —  C2a'  *  <W- 


(4.7) 


2  2 

When  H2  is  true,  (nr^/ (<+l)  , . . .  ,nr  /(tc+l))is  asymptotically  distributed  independent 


2  2. 

of  r^  and  r^  and  is  the  same  as  the  joint  distribution  of  the  eigenvalues  of  the  centri 


Wishart  matrix  W(p^-2,p2~2 ;I).  We  continue  this  procedure  until  a  decision  is 
made  about  the  rank  of  the  canonical  correlation  matrix. 

When  the  underlying  distribution  Is  complex  elliptical,  we  can  propose  test 
procedures  on  the  rank  of  the  canonical  correlation  matrix  in  the  same  way  as 
above.  We  will  now  discuss  applications  of  these  procedures  in  the  area  of  time 
series  in  the  frequency  domain. 

Let  X' (t)  *  (X|(t),X^(t)),  (t  *  1,2,...,T),  be  a  l*u  random  vector  which  is 
distributed  as  a  stationary  Gaussian  multivariate  time  series  with  zero  mean  vector 
and  covariance  matrix  R(v)  -  E{X(t)X* (t+v)}.  Also,  let  the  spectral  density  matrix 


be  denoted  by  F(u>) 


F(uj)  ■  (l/2ir)  £  exp(-ivw)R(v) 


(4.8) 


where 


F  (u>)  ” 


Fi2^^ 


^21  Cuj  )  F22^^ 


(4.9) 


F^j(u)  is  of  order  p^xp^ .  An  estimate  of  F(ui)  is  known  (e.g.,  see  Parzen 
(1969)  and  Brillinger  (1975))  to  be  F(u)  -  (f  .  (oi))  where 


V“>  -  csfe-  ?  V-K2W/T)) 

a--m 

Ijk(w)  -  Zj(a))2k(a)) 

T 

2  (to)  -  (1/ (2irT)1/2)  l  X(t)exp(-itu>  ) 
J  t-1 


(4.10) 


and  X'(t)*  (Xj^(t)  , . . .  ,Sp(t))  .  It  is  known  (see  Goodman  (1963)  and  Wahba  (1968)) 

A 

that  F(w)  is  approximately  distributed  as  complex  Wishart  matrix  with  (2nrt-l)  degrees 

A 

of  freedom  and  E{F(u))}  -  (2m+l)F(.w) .  So,  we  can  test  for  the  rank  of  F^Cw)  by 
following  the  methods  described  before  in  this  paper. 


Mamas  > 


24 


REFERENCES 


1.  ANDERSON,  T.W.  and  FANG,  K.  (1982).  Maximum  likelihood  estimators  and 
likelihood  ratio  criteria  for  multivariate  elliptically  contoured  dis¬ 
tribution.  Technical  Rept.  No.  1,  Department  of  Statistics,  Stanford 
University. 

2.  BAI ,  Z.D.  (1984).  A  note  on  asymptotic  joint  distribution  of  the  eigen- 
balues  of  a  noncentral  multivariate  F  matrix.  Technical  Rept.  No.  84-49. 
Center  for  Multivariate  Analysis,  University  of  Pittsburgh. 

3.  BARTLETT,  M.S.  (1974).  Multivariate  analysis.  J.R.  Statist.  Soc.  (suppl.) 

9,  176-190. 

4.  BRILLINGER,  D.R.  (1975).  Time  Series:  Data  Analysis  and  Theory.  Holt, 

Rinehart  and  Winston,  Inc. 

5.  CAMBANIS,  S.,  HWANG,  S.  and  SIMONS,  G.  (1981).  On  the  theory  of  ellip¬ 
tically  contoured  distributions.  J.  Multivariate  Anal.  11,  368-385. 

6.  DEVLIN,  S.J.  GNANADESIKAN,  R.  and  KETTENRING,  J.  (1975).  Robust  estima¬ 
tion  and  outlier  detection  with  correlation  coefficients.  Biometrika 
62,  531-545. 

7.  FANG,  C.  and  KRISHNAIAH,  P.R.  (1982).  Asymptotic  distributions  of  functions 
of  the  eigenvalues  of  some  random  matrices  for  nonnormal  populations. 

J.  Multivariate  Anal.. 12,  39-63. 

8.  FUJIKOSHI,  T.  (1974).  The  likelihood  ratio  tests  for  the  dimensionality  of 
regression  coefficients.  J.  Multivariate  Anal.. 4,  327-340. 

9.  FUJIKOSHI,  Y.  (1978).  Asymptotic  expansions  for  the  distributions  of  some 
functions  of  the  latent  roots  of  matrices  in  three  situations.  J.  Multivariate 
Anal . f8,  63-72. 

10.  GOODMAN,  N.R.  (1963).  Statistical  analysis  based  on  a  certain  multivariate 
complex  Gaussian  distribution  (an  Introduction).  Ann.  Math.  Statist.,  34, 
152-176. 

11.  HSU,  P.L.  (1939).  On  the  distribution  of  roots  of  certain  determlnantal 
equations.  Ann .  Eugen . ,  9,  238-249. 

12.  HSU,  P.L.  (1941a).  On  the  limiting  distribution  of  roots  of  a  determlnantal 
equations.  J.  London  Math.  Soc.,  16.  183-194. 

13.  HSU,  P.L.  (1941b).  On  the  limiting  distribution  of  the  canonical  correla¬ 
tions.  Biometrika.  32.  38-45. 

14.  KELKER,  D.  (1970).  Distribution  theory  of  spherical  distribution  and 
location  scale  parameter  generalization.  Sankhyl.  43,  419-430. 

15.  KRISHNAIAH,  P.R.  (1980).  Computations  of  some  multivariate  distributions 
In  Handbook  of  Statistics,  Vol.  1  (P.R.  Krishnalah,  editor),  pp.  745-971. 
North-Holland  Publishing  Company. 


w-y-y* 


25 


16.  KRISHNAIAH ,  P.R.  and  LEE,  J.C.  (1979).  On  the  asymptotic  joint 
distribution  of  certain  functions  of  the  eigenvalues  of  four  random 
matrices.  J.  Multivariate  Anal.. 9.  248  -  258. 

— 9  <V  9 

17.  KRISHNAIAH ,  P.R.  and  LIN,  J.  (1984).  Complex  elliptical  distributions. 
Tech.  Rept.  No.  84-19.  Center  for  Multivariate  Analysis,  University 
of  Pittsburgh. 

18.  MAR0NNA,R.  A.  (1976).  Robust  M-estlmators  of  multivariate  location 
and  scatter.  Ann.  Statist.  6.  51  -  67. 

19.  MORIHEAD,  R.  J.  and  WATERNAUX,  C.M.  (1980).  Asymptotic  distributions 

in  canonical  correlation  analysis  and  other  multivariate  procedures 
for  nonnormal  populations.  Bionetrlka.  67,  31-43. 

20.  PARZEN,  E.  (1969).  Multiple  time  series  modelling.  In  Multivariate 
Analysis  II  (P.R.  Krishnaiah,  editor).  Academic  Press,  Inc. 

21.  WAHBA,  G.  (1968).  On  the  distributions  of  some  statistics  useful  in 
the  analysis  of  jointly  stationary  time  series.  Ann.  Math  Statist., 

39.  1849  -  1862. 


SfcCuHf  ry  classification  this  paol  «••• 


REPORT  DOCUMENTATION  PAGE  BEFORE  COM P L€ TIN G^KORM 


|2.  GOVT  ACCESSION  NO.I  >  RECIGIENT’S  CATALOG  HUM  GCA 


85-14 


4.  TITLE  Cant/  Svbtulo) 


»  t yne  or  rerort  a  rerioo  covereo 


INFERENCE  ON  THE  RANKS  OF  THE  CANONICAL  CORRELA-  Technical  -  May  1985 
TION  MATRICES  FOR  ELLIPTICALLY  SYMMETRIC  1 

POPULATIONS 


1  AUTHOM/ai 


P.R.  Krishnaiah,  J,  Lin  and  L.t  Vang 


a.  COMTNACT  ON  GNAnT  NUMGERfaJ 


F49620-85-C-0008 


a  performing  ongamiiatiom  name  and  aooress 
Center  for  Multivariate  Analysis 
Unlv.  of  Pittsburgh,  Fifth  Floor,  Thackeray  Hall 
Pittsburgh,  PA  15260 


II.  CONTNOLLING  OFFICE  NAME  ANO  ADDRESS 

Air  Force  Office  ‘of  Scientific  Research 
Department  of  the  Air  Force 
Boll 


10.  FNOGNAM  ELEMENT.  GROJECT.  TAM 
ANSA  •  WORK  UNIT  NUMGERS 


MONITORING  ACEnCV  name  *  AOORESSfH  dJfteranl  from  Controlling  OHico)  SECURITY  CLASS.  (ol  this  report) 

Unclassified 


ISa.  OECLASSIFiCATION/OOGNGRAOING 
SCHEDULE 


10.  QISTMI GUTION  STATEMENT  (of  (A/a  Moporl) 


Approved  for  public  release;  distribution  unlimited 


IT  mSTRiapTION  STATEMENT  (ol  (Aa  aAa tract  entered  In  Slack  it,  II  dlllotont  from  Report) 


l*  KEY  WORDS  (Continue  on  terotoe  alGa  II  naaaaa my  and  idonllly  Or  Mack  number) 

Asymptotic  distributions,  complex  distributions,  canonical  correlations, 
elliptical  distribution,  and  time  series. 


20  AGS  TRACT  (Continue  an  ravoraa  tide  II  nacacaarr  ana  Idem  ilr  by  block  number) 

In  this  paper,  the  authors  considered  the  likelihood  ratio  tests  and  some 
other  tests  for  the  ranks  of  the  canonical  correlation  matrices  when  the  under¬ 
lying  distributions  are  real  and  complex  elliptically  symmetric  distributions.  . 
Also,  asymptotic  joint  distributions  of  the  eigenvalues  of  the  sample  canonical 
correlation  matrices  are  derived  under  the  assumptions  mentioned  above  regarding 
the  underlying  distributions.  Finally,  applications  of  tests  for  the  rank  of 
the  complex  canonical  correlation  matrix  in  the  area  of  time  series  in  the  fre¬ 
quency  domain  are  discussed. 


IAN  T1  ■> 


UNCLASSIFIED  _ 

SECURITY  CLASSIFICATION  of  This  RAGE  fRfco n  Dote  Entered) 


END 

FILMED 

10-85 

DTIC 


